Searching PAJ 



Page 1 of 2 



PATENT ABSTRACTS OF JAPAN 



(1 1 )Publication number : 2000-099686 
(43)Date of publication of application : 07.04.2000 



r 



(51)lnt.CI. 



G06T 1/00 
G06T 7/20 
G06T 7/00 



// G08G 1/16 



> 



(21)Application number : 10-263378 



(71)Applicant 



NIPPON TELEGR & TELEPH 
CORP <NTT> 



(22)Date of filing : 



17.09.1998 



(72)lnventor : 



SAKUMA SATOSHI 
TAKAHASHI HIROKO 
SHIO AKIO 
OTSUKASAKUICHI 



(54) PATTERN RECOGNITION AND VEHICLE RECOGNITION METHOD AND STORAGE 

MEDIUM RECORDING ITS PROGRAM 

(57)Abstract: 

PROBLEM TO BE SOLVED: To recognize a specific pattern or a vehicle from image data 
photographed at a constant moving distance interval when an observation side and an object 
to be recognized are relatively moved. 

SOLUTION: An observation side at which a line sensor camera is set and an object including 
a specific pattern to be recognized are relatively moved in parallel, and when the object is 
photographed at a constant relative moving distance interval, the specific pattern is 
recognized from the time-sequential image data. In this case, the template of the specific 
pattern which is previously recorded in the line axial direction of the line sensor camera is 
enlarged and reduced, and the template is compared with the image data so that the similarity 
of the pattern can be calculated, and the specific pattern can be recognized from the image 
data by using the similarity of the pattern. 
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* NOTICES * 

Japan Patent Office is not responsible for any 
dam ages caused by the use of this translation. 

1 .This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2.**** shows the word which can not be translated. 
3. In the drawings, any words are not translated. 



DETAILED DESCRIPTION 

[Detailed Description of the Invention] 
[0001] 

[The technical field to which invention belongs] This invention relates to the image-processing method 
for performing recognition or vehicles recognition of a specific pattern from the image data photoed 
using the line sensor camera. 
[0002] 

[Description of the Prior Art] As for the processing technology over the time series image data a 
photograph of was taken outside using the line sensor camera, the following exists. (1) In the huge 
image database for the maintenance management for railroads (reference 1 : Institute of Image 
Electronics Engineers of Japan study group draft 95-02 -01 reference), or (2) road-surface condition test 
equipment (reference 2: refer to JP,6-129845,A), simple filtering, such as an edge extract and binary- 
ized processing, is performing crack detection of a tunnel wall or a rail. 

[0003] Moreover, with the (3) body existence judging method, the body migration judging method, and 
its operation equipment (reference 3: nine to Japanese-Patent- Application-No. 317013 reference), a 
body field is limited out of the image photoed by the line sensor using the distance robot, a circle is 
extracted as a wheel outline in the field, and the method of recognizing a wheel is described. 
[0004] It has been used mostly because of object recognitions, such as vehicles detection of a parking lot 
within the limit, for the method of it being characterized by the front section and the back section of 
vehicles for failure vehicles or parking vehicles discovery, and on the other hand identifying vehicles 
about (4) vehicles extract, or parking lot management (reference 4: "the present condition of the image 
recognition in a road transportation system, and a technical technical problem", the Institute of 
Electronics, Information and Communication Engineers PRMU study group, 1997/05/16 reference). 
These used the fixed area sensor, and they came considering the image which photoed vehicles forward 
back as a candidate for recognition in order to recognize many vehicles. 
[0005] 

[Problem(s) to be Solved by the Invention] However, the candidate for recognition stands in a row 
relatively the observation side of said line sensor camera etc., and it moves, and when the technical 
problem which recognizes a specific pattern from the time series image data photoed at intervals of fixed 
migration length is consider, only recognition of a diagram with simple crack, wheel edge, etc. is 
conventionally make into an object, and pattern recognition of an arbitration graphic form is not 
perform. 

[0006] Moreover, with the conventional vehicles recognition technology, an approach which recognizes 
vehicles is not made by extracting the specific pattern of the image empty vehicle both-sides side from a 
line sensor camera. 

[0007] The candidate for recognition moves relatively an observation side, and the purpose of this 
invention is to offer the technology whose recognition of a specific pattern or vehicles is attained from 
the image data photoed at intervals of fixed migration length. 

[0008] Other purposes and new features are clarified by description and the accompanying drawing of 
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this specification at said row of this invention. 
[0009] 

[Means for Solving the Problem] It is as follows when an outline of a typical thing is briefly explained 
among invention indicated by this application. 

[0010] (1) A body with which a specific pattern which should be recognized an observation side in 
which a line sensor camera is installed is contained stands in a row relatively, and moves. It is the 
pattern recognition method of recognizing a specific pattern from time series image data which photoed 
a body at intervals of fixed relative migration distance. Zooming of the template of a specific pattern 
currently beforehand recorded to the Rhine shaft orientations of said line sensor camera is carried out. It 
is the method of calculating similarity of a pattern by comparing this template with said image data, and 
recognizing a specific pattern from said image data using similarity of this pattern. 
[001 1] (2) a procedure which calculates similarity of a pattern by comparing said image data and 
template in a pattern recognition method of the above (1) — an image of both image data and a template 
— it is the procedure which lowers and compares resolution and calculates similarity. 
[0012] (3) It is the record medium which recorded a program for making a computer perform procedure 
of a pattern recognition method of the above (1) and which can be read. 

[0013] (4) It is the record medium which recorded a program for making a computer perform procedure 
of a pattern recognition method of the above (2) and which can be read. 

[0014] (5) Vehicles which should be recognized an observation side in which a line sensor camera is 
installed stand in a row relatively, and move. It is the vehicles recognition method of recognizing stop 
vehicles from time series image data which photoed vehicles at intervals of fixed relative migration 
distance. Zooming of the template of a specific pattern currently beforehand recorded to the Rhine shaft 
orientations of said line sensor camera is carried out. It is the method of recognizing vehicles which 
calculate similarity of a wheel pattern by comparing this template with said image data, match the same 
wheel based on similarity of this wheel pattern, and contain said matched wheel group. 
[0015] (6) a procedure which calculates similarity by comparing said image data and said template in a 
vehicles recognition method of the above (5) » an image of both image data and a template ~ it is the 
procedure which lowers and compares resolution and calculates similarity. 

[0016] (7) It is the record medium which recorded a program for making a computer perform procedure 
of a vehicles recognition method of the above (5) and which can be read. 

[0017] (8) It is the record medium which recorded a program for making a computer perform procedure 
of a vehicles recognition method of the above (5) and which can be read. 

[0018] Namely, a body with which a specific pattern which should be recognized an observation side in 
which a line sensor camera is installed is contained arranges this invention in parallel relatively, and 
moves it. It is the method of recognizing a specific pattern from time series image data which photoed 
the body side at intervals of fixed relative migration distance. A procedure which carries out zooming of 
the template of a specific pattern currently beforehand recorded to the Rhine shaft orientations of a line 
sensor camera, This template is compared with said image data, and it is characterized by having a 
procedure which calculates similarity, and a procedure of recognizing a specific pattern from said image 
data using said similarity. 

[0019] In this invention, a candidate for recognition stands in a row relatively an observation side, it 
moves, and it becomes possible to recognize a specific pattern and vehicles which should be recognized 
from time series image data photoed at intervals of fixed relative migration distance. Moreover, 
regardless of not cover-half pattern recognition equipment with which the conventional installation is 
restricted but indoor, and the outdoors, movable pattern recognition equipment becomes realizable. 
[0020] 

[Embodiment of the Invention] The operation gestalt (example) of the following this inventions is 
explained with reference to a drawing. 

[0021] (Operation gestalt 1) Drawing 1 is the block block diagram showing the outline configuration of 
the pattern recognition equipment of the operation gestalt (example) 1 of this invention. As the pattern 
recognition equipment of this operation gestalt (example) 1 is shown in drawing 1 , the displays 103, 
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such as storage 102 and a display, are connected to an information processor (CPU) 101 through a bus 
line 109. 

[0022] Drawing 2 is a flow chart which shows the procedure of the specific pattern recognition method 
of the operation gestalt 1 of this invention. The body with which the specific pattern which should be 
recognized the observation side in which a line sensor camera is installed as shown in drawing 2 is 
contained arranges in parallel relatively the specific pattern recognition method of this operation gestalt 
1, and moves it, and the time series image data S101 which photoed the body at intervals of fixed 
relative migration distance is memorized by storage 102. The time series image data (S101) by which 
reading appearance was carried out is inputted into an information processor (CPU) 101, and 
pretreatment of binary-izing of an image, elimination of a wheel pattern, etc. is performed to this 
inputted time series image data (SI 01) (input process: SI 02). The similarity of a pattern is calculated by 
carrying out zooming of the template image (SI 03) of the specific pattern memorized beforehand to said 
storage 102 to the Rhine shaft orientations of a line sensor camera, and comparing image data and a 
template (SI 05). [ finishing / said pretreatment ] Based on the similarity of this pattern, a specific pattern 
is recognized from said image data (SI 06). This recognized specific pattern is displayed on a display 
103 (SI 07). The details of the count method of the similarity of said pattern are indicated by the 
Japanese-Patent- Application-No. No. 317013 [ nine to ] specification of reference 3. Here, it omits. 
[0023] According to this operation gestalt 1, the candidate for recognition stands in a row relatively an 
observation side, it moves, and it becomes possible to recognize the specific pattern which should be 
recognized from the time series image data photoed at intervals of fixed relative migration distance. 
Moreover, regardless of not the cover-half pattern recognition equipment with which the conventional 
installation is restricted but indoor, and the outdoors, movable pattern recognition equipment becomes 
realizable. 

[0024] (Operation gestalt 2) In this operation gestalt (example) 2, let the observation side of this 
invention as migration vehicles, and let the specific pattern which should be recognized be the wheel of 
stop vehicles. A time-series-data image is installed in the side of migration vehicles, and photos the side 
of stop vehicles. Here, although it becomes the slow image with which the anterior part or the posterior 
part of stop vehicles is reflected when the line sensor camera is not perpendicularly installed to the 
migration direction, it does not matter. 

[0025] Drawing 3 is the block block diagram showing the outline configuration of the vehicles 
recognition equipment of the operation gestalt (example) 2 of this invention. A display 103 and 
measuring devices 104, such as storage 102 and a display, are connected to the information processor 
(CPU) 101 shown in drawing 3 through a bus line 109. However, in storage 102, the measured- value are 
recording section 107 and the body shape facility are recording section 108 are formed. Moreover, in a 
measuring device 104, a distance robot 105 and the line sensor camera 106 are formed. Here, distance 
robots 105 are distance measuring equipment, such as for example, a millimeter wave radar and an 
ultrasonic sensor. 

[0026] Drawing 4 is equipment which acquires the image data in the vehicles recognition method of this 
operation gestalt 2. In drawing 4 , use as the stop vehicles 201 on the road shoulder the vehicles 
containing the wheel which is the specific pattern which should be recognized, and let the observation 
side containing the line sensor camera 205 be the migration vehicles 202. The Rhine shaft of the line 
sensor camera 205 is perpendicularly set up to the ground. The rotary encoder 204 for recording the 
output from the line sensor camera 205 at intervals of the fixed mileage of the migration vehicles 202 is 
attached in the migration vehicles 202. 

[0027] Said rotary encoder 204 is a measuring instrument used for detecting angle change and angular 
velocity of the portion which rotates a machinery, and can measure migration length from the 
circumference length and rotational frequency of a rotary. In this invention, the migration length which 
had the output from a licenser camera measured, and the image data simply obtained in accordance with 
the synchronization serve as magnitude of thing in the migration direction. 

[0028] Drawing 5 is drawing showing the line sensor image and wheel template image of this operation 
gestalt 2, and, for a line sensor image and 302, as for a wheel image and 402, a wheel and 401 are [ 301 / 
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the wheel image after stopgap processing and 501 ] wheel template images. Drawing 6 is drawing 
showing the image of the wheel field in the image data this operation gestalt 2 has been recognized to 
be, and, as for the distance between wheels, and 602, 601 is [ the wheel image A (wheel texture A) and 
603 ] the wheel images B (wheel texture B). 

[0029] As shown in drawing 5 , a wheel 302 consists of the tire section and the wheel section, and, 
generally the tire section becomes dark from the wheel section in a shade image. Therefore, binary-ized 
processing (reference 5: "an image-analysis handbook", University of Tokyo publication) is performed 
so that a threshold may be established between the brightness value of the tire section, and the 
brightness value of the wheel section, and the wheel section separates white and the tire section like 
black. In order that a wheel pattern may remain into the wheel section, stopgap processing by mol 
follow G (reference 6: "mol follow G", Corona Publishing) is performed in the image which binary-- 
ization-processed the line sensor image 301. Therefore, the wheel image 401 turns into the wheel image 
402 after the stopgap processing to which the wheel pattern disappeared ((b) of drawing 5 ). The wheel 
template image 501 shown in (c) of said drawing 5 is beforehand recorded on storage, such as memory, 
(storage). 

[0030] Drawing 7 is a flow chart which shows the procedure of the wheel recognition method by said 
pattern recognition method of this operation gestalt 2. 

[003 1] The stop vehicles 201 which should be recognized to be the migration vehicles 202 by the side of 
the observation in which the line sensor camera 205 is installed as shown in drawin g 7 arrange in 
parallel relatively the wheel recognition method of this operation gestalt 2, and move it, and the time 
series image data S201 of the stop vehicles 201 which photoed the stop vehicles 201 at intervals of fixed 
relative migration distance is memorized by storage 102. The time series image data (S201) by which 
reading appearance was carried out is inputted into an information processor (CPU) 101, pretreatment of 
binary-izing of an image, elimination of a wheel pattern, etc. is performed to this inputted time series 
image data (S201) (S202), and it is divided into a block (S203). The time series image data divided into 
this block is inputted into an information processor (CPU) 101, and, on the other hand, the wheel 
template image (template image of a specific pattern) 501 (S204) is inputted. 

[0032] a correlation value with the image which zooming processing of the Rhine shaft orientations of 
the template image 501 was performed (S205), and carried out zooming processing of 1 block and the 
wheel template image 501 (S204) in time series image data in said information processor (CPU) 101, 
and difference — similarity is calculated by calculating a value (S206). The calculated similarity 
investigates whether it is beyond a certain threshold (S207). If it is beyond a threshold with similarity, 
the block of this image data will be recognized that a wheel exists (S208), and will display that result on 
a display 103 (S21 1). If it will be fixed within the limits and it will investigate whether a scale-factor 
change of zooming processing of a wheel template image was made, if it is below a threshold with 
similarity (S209), and a scale-factor change of a wheel template image is made, the block of this image 
data will be recognized that a wheel does not exist (S210), and will display that result on a display 103 
(S211). 

[0033] Next, if pattern recognition processing of all blocks of image data finishes, pattern recognition 
processing is ended and no pattern recognition processing of blocks has finished, it returns to a step 
(S205) and said processing is repeated (S212). 

[0034] said similarity count — the image of time series image data and a wheel template image - the 
difference in the magnitude of the wheel for every vehicles can be cajoled in the range of a quantization 
error also by dropping resolution. Therefore, it becomes possible to perform similarity count of the 
wheel of two or more magnitude by one wheel template image. 

[0035] Drawing 8 is a flow chart which shows the procedure of the method of recognizing vehicles 
using said wheel recognition method of this operation gestalt 2. 

[0036] As the vehicles recognition method of this operation gestalt 2 is shown in drawing 8 , a wheel is 
recognized using said wheel recognition method (S301). Next, it investigates whether vehicles have 
stopped (S302). If vehicles have stopped, the wheel of the same vehicles based on the similarity of a 
wheel pattern will be matched about the recognized wheel group (S303). (in count of similarity, from the 
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aspect ratio which was able to be obtained from enlarging-or-contracting processing of the Rhine shaft 
orientations, a wheel image is returned to the aspect ratio of 1:1, and is performed) (In addition, the 
details of count of similarity are indicated by the specification of Japanese Patent Application No. No. 
317013 [nine to]) . 

[0037] That is, since the distance between two cars may become shorter than the distance 601 ( drawing 
6 ) between wheels when stop vehicles are carrying out column parking, in S3 03, the image similarity of 
the recognized wheel group is calculated, a wheel is matched based on similarity, and vehicles are 
recognized. It can ask for this similarity as follows. As shown in drawing 6 , let the images of the wheel 
field in the image data recognized with this operation gestalt 2 be the wheel image A602 and the wheel 
image B603. At the time of wheel recognition, the aspect ratio of image data is called for in zooming 
processing of the Rhine shaft orientations. Therefore, based on this ratio, a wheel image is returned to 
the actual aspect ratio of 1:1, and the similarity of an image is calculated. However, similarity may be 
calculated by rotating wheel image of one of the two. Thus, it becomes possible to recognize stop 
vehicles. 

[0038] If vehicles have not stopped, the wheel of the same vehicles by the threshold processing to the 
distance between wheels is matched about the recognized wheel group (S304). The vehicles containing 
the matched wheel group are recognized (S305). 

[0039] That is, when the vehicles which should be recognized are moving, generally compared with the 
distance between two cars, the distance between the ****** wheels of the same vehicles (distance 601 
between wheels) becomes small. Therefore, the wheel group in which the same vehicles are contained is 
determined by recognizing a wheel like this operation gestalt 2, and performing threshold processing to 
the distance 601 between wheels. This method enables it to recognize migration vehicles. 
[0040] According to this operation gestalt 2, vehicles can be recognized by using the vehicles 
recognition method from the image which the body which should be recognized an observation side 
moves relatively and is photoed so that the above explanation may show. 

[0041] As mentioned above, although this invention was concretely explained based on said operation 
gestalt (example), it cannot be overemphasized that it can change variously in the range which this 
invention is not limited to said operation gestalt, and does not deviate from the summary. 
[0042] 

[Effect of the Invention] As explained above, according to this invention, a specific pattern or vehicles 
can be recognized by using pattern recognition or the vehicles recognition method from the image which 
the body which should be recognized an observation side moves relatively and is photoed. 



[Translation done.] 
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3. In the drawings, any words are not translated. 



CLAIMS 



[Claim(s)] 

[Claim 1] A body with which a specific pattern which should be recognized an observation side in 
which a line sensor camera is installed is contained stands in a row relatively, and moves. It is the 
pattern recognition method of recognizing a specific pattern from time series image data which photoed 
a body at intervals of fixed relative migration distance. Zooming of the template of a specific pattern 
currently beforehand recorded to the Rhine shaft orientations of said line sensor camera is carried out. A 
pattern recognition method characterized by calculating similarity of a pattern by comparing this 
template with said image data, and recognizing a specific pattern from said image data using similarity 
of this pattern. 

[Claim 2] a procedure which calculates similarity of a pattern by comparing said image data and 
template in a pattern recognition method according to claim 1 — an image of both image data and a 
template — a pattern recognition method characterized by being the procedure which lowers and 
compares resolution and calculates similarity. 

[Claim 3] A procedure to which a body with which a specific pattern which should be recognized an 
observation side in which a line sensor camera is installed is contained stands in a row relatively, and it 
is made to move, A procedure of obtaining time series image data which photoed a body at intervals of 
fixed relative migration distance, A procedure which carries out zooming of the template of a specific 
pattern currently beforehand recorded to the Rhine shaft orientations of said line sensor camera, A 
record medium which recorded a program for making a computer perform a procedure which calculates 
similarity of a wheel pattern by comparing said image data and said template and which can be read. 
[Claim 4] a procedure which calculates similarity of a pattern by comparing said image data and 
template in a record medium according to claim 3 — an image of both image data and a template — a 
record medium characterized by being the procedure which lowers and compares resolution and 
calculates similarity. 

[Claim 5] Vehicles which should be recognized an observation side in which a line sensor camera is 
installed stand in a row relatively, and move. It is the vehicles recognition method of recognizing stop 
vehicles from time series image data which photoed vehicles at intervals of fixed relative migration 
distance. Zooming of the template of a specific pattern currently beforehand recorded to the Rhine shaft 
orientations of said line sensor camera is carried out. A vehicles recognition method of recognizing 
vehicles which calculate similarity of a wheel pattern by comparing this template with said image data, 
match the same wheel based on similarity of this wheel pattern, and contain said matched wheel group. 
[Claim 6] a procedure which calculates similarity by comparing said image data and said template in a 
vehicles recognition method according to claim 5 — an image of both image data and a template — a 
vehicles recognition method characterized by being the procedure which lowers and compares resolution 
and calculates similarity. 

[Claim 7] A record medium which recorded a program for making a computer perform a procedure of 
recognizing vehicles characterized by providing the following and which can be read A procedure which 
vehicles which should be recognized an observation side in which a line sensor camera is installed 
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arrange in parallel relatively, and move A procedure of recognizing a wheel pattern of vehicles from 
time series image data which photoed vehicles at intervals of fixed relative migration distance A 
procedure which carries out zooming of the template of a specific pattern currently beforehand recorded 
to the Rhine shaft orientations of said line sensor camera A procedure which calculates similarity of a 
wheel pattern by comparing said image data and said template, a procedure which matches the same 
wheel based on similarity of said wheel pattern, and said matched wheel group 

[Claim 8] a procedure which calculates similarity by comparing said image data and said template in a 
record medium according to claim 7 — an image of both image data and a template — a record medium 
characterized by being the procedure which lowers and compares resolution and calculates similarity of 
a wheel pattern. 



[Translation done.] 
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